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1.  INTRODUCTION.  Since  its  inception  integer  linear  programming 
has,  paradoxically,  been  a  3ource  of  both  promise  and  disappointment „  Pro¬ 
mise  because  there  are  manifold  and  compelling  opportunities  fox'  its  appli¬ 
cation;  disappointment  because  it  has  made  only  the  most  dubious  progress 
in  spite  of  these  opportunities,. 

In  contrast,  the  remarkable  growth  of  traditional  linear  programming 
is  well  known.  The  question  arises  as  to  what  causes  this  difference. 

Harold  Kuhn  and  Richard  wuandt  cite  three  factors  to  account  for  the  success 
of  linear  programming.  1 /  They  are  (a)  its  flexibility  and  wide  range  of 
application,  (b)  the  parallel  development  of  large  electronic  computers „  and 
(c)  the  discovery  of  the  simplex  method,  an  efficient  algorithm  which  solves 
problems  at  a.  reasonable  cost  in  time.  Of  these  factors.,  the  one?  which  seems 
most  nearly  to  explain  the  contrast  between  the  ascension  of  traditional 
lineai'  programming  and  the  lagging  debut  of  its  integer  relative  is  the 
last,.  There  are  no  integer  programming  algorithms  with  the  high  efficiency 
of  the  simplex  method. 

The  difficulties  with  the  integer  algorithms  ax*e  of  two  distinct 
types,.  First,  there  are  many  problems  which  appear  wholly  impervious  to 
themf  though  the  algorithms  are  theoretically  assured  of  finding  a  solution, 
second,  the  algorithms  give  fiddle  performances  even  in  solving  those  pro¬ 
blems  which  are  more  tractable.  For  this  latter  category  of  problems  the 
success  of  the  integer  algorithms  depends  heavily  on  the  sequence  of  select¬ 
ing  pivotal  constraints.  Frequently  a  problem  which  requires  an  inordinate 
number  of  pivots  using  one  sequence  will  yield  after  a  fraction  of  that 
number  to  another.. 

It  is  sometimes  possible,  by  examining  an  efficient  pivot  sequence 
for  a  specific  problem,  to  infer  a  (.ensral  rule  which  will  work  well  on  the 


problem  investigated <.  Unfortunately,,  there  seem  to  be  no  existing  rule 
which  is  good  for  all  problems,  nor  which  makes  any  appreciable  inroad  into 
the  large  region  of  problems  which  uniforniy  resist  the  efforts  of  the  best 
alternate  approaches. 

The  initial  purpose  of  this  study  was  to  seek  a  strategy  of  pivot 
selection  that  'would  abandon  the  profligacy  of  existing  rules.  The  algorithm 
at  the  focus  of  our  investigations  was  bo  be,  and  has  principally  been,  the 
all-integer  integer  programming  algorithm  proposed  by  halph  Gomory  in  January 
I960.  2 /  However,  as  our  work  has  progressed,  we  have  developed  two  supple¬ 

mentary  techniques,  based,  on  ths  simplex  method,  which  may  be  applied  inde¬ 
pendently  of  any  specific  rule  of  choice.  One  of  these,  the  New  Origin 
Technique  (NOT),  described  in  Section  4 B,  has  proved  Sufficiently  pronu.3ing 
to  earn  a  distinguished  position  among  the  strategies^  presented  in  this  re¬ 
port »  Thus  we  have  come  to  attack  the  tardiness  of’jfhe  integer  programming 
algorithmj in  two  ways:  by  developing  and  testing  rules  for  selecting  pivotal, 
constraints,  and  by  introducing  two  methods  for  boosting  the  problem  toward 
solution  before  the  pivot  rules  are  applied., 

Hr  TH:,  -Ail,  INTmGiift  IdTiiGoif.  FjtXljAhMlW  A\,G0r.ITHK.  Gomory’ s  ail 
integer  integer  pro&rajnraing  algorithm  resembles  the  simplex  in  several  ways  . 
the  distinguishing,  feature  of  the  algorithm  is  the  creation  of  a  transitory 
constraint  which  is  used  for  pivoting  and  then  discarded.  Underlying  this 
feature  is  the  principle  that  each  constraint  in  the  all  integer  tableau 
Implies  the  existence  of  a  special  set  of  secondary  constraints.  The  second¬ 
ary  constraints  must  all  be  satisfied  by  any  integer  solution  to  the  original 
problem,  and  .-ire  eligible  for  pivoting  if  and  only  if  the  constraint  which 
sired  them  is  eligible.  Ths  process  of  pivot  selection  consists  in  ch  :oain,j 
one  of  the  eligible  constraints  from  bhe  tableau,  and  then  locating  the 
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unique  secondary  constraint  which  satisfies  the  following  two  properties: 

^1)  it  ha3  a  pivot  element  of  -.l,  and  (2)  of  those  constraints  shai’ing 
property  one0  it  causes  the  largest  decrease  in  the  objective  function- 
The  "new  pivotal  constraint"  is  temporarily  annexed  to  the  tableau  so  that 
the  pivot  operation  may  be  carried  out  on  it.  Afterwards  it  is  discarded s 
end  the  process  repeated* 

In  Gomory's  tableau  the  constraints  correspond  to  column  vectors.. 

The  new  pivotal  constraint  is  uniquely  determined  by  the  eligible  constraint 
from  which  it  is  derived..  Hence  we  will  speak  of  pivoting  on  a  column  in 
the  permanent  tableau 5  though  the  actual  pivot  operation  is  carried  out  on 
the  derivative  column*  For  the  convenience  of  the  reader,  Gomory's  algorithm, 
is  outlined  in  its  entirety  in  appendix  A* 

3*  PIVOT  .iELi&TlQN  KULbd,  A  column  in  Gomory’s  tableau  is  eligible 
for  pivoting  whenever  its  bottom  row  element  is  negative,  hones  the  choice 
of  pivots  may  be  referred  to  as  a  ciioj.ce  among  negative  indicators..  There 
are  clearly  many  strategies  by  which  such  choices  could  be  made,,  Though 
some  limited  value  might  come  from  testing  rules  that  have  been  fabricated 
arbitrarily,  we  have  chosen  to  restrict  ourselves  to  rules  for  which  wo 
could  give  some  intuitive,  practical  or  theoretical  justification, 

A*  Fj.rst  Negative  indicator.---,  The  first  negative  indie. tor  rule 
says  to  select  the  eligible  eoiunn  with  the  least  .index,  In  his  paper  on 
all  integer  programming  Gomory  cites  this  rule  as  one  for  which  a  finite 
number  of  pivots  is  guaranteed*  Its  advantage  is  its  extreme  simplicity; 
the  computer  wastes  no  time  between  pivot  operations.  Compared  to  any 
rule  which  requires  the  same  number  of  pivots,  the  first  negative  indicate 
rule  must  prove  at  least  as  efficient 

B.  uandom  Pivot  dejection, --The  name  of  this  rule  is  its  description; 


it  simply  directs  that  a  negative  indicator  be  chosen  at  random..  Like  the 


0 
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first  negative  indicator  rule, «the  random  rule  works  rapidly-  Moreover,  it 
is  a  normative  rule:  hopefully  we  should  expect  any  truly  effective  rule  to 
do  as  well.!  Finally s  the  random  rule  makes  it  possible  to  get  an  idea  of  the 
distribution  of  the  number  of  pivots  required  to  reach  solution  by  making 
successive  solution  attempts  on  a  single  problem  with  a  variety  of  random 
number  bases., 

C .  handon  itestart  Rule— -Our  early  experimentation  with  the  random 
pivot  choice  rule  showed  us  that  the  variation  in  the  number  of  pivots  re¬ 
quired  to  solve  even  the  more  manageable  problems  by  Gomory ' s  algorithm  was 
exceedingly  large  -  Gmail  problems  were  almost  as  notorious  in  this  respect 
as  larger  ones.  A  six  variable  six  inequality  problem  had  to  be  taken  off 
the  computer  unsolved  after  5.96(XJ  pivots  using  one  random  number  base,  yet 
was  solved  in  less  than  40  pivots  using  another.  The  thought  naturally 
arises  that  a  program  for  arresting  work  on  a  problem  after  a  pre-established 
number  of  pivots f  and  then  starting  anew,  might  pay  off  in  more  consistent 
results..  Any  stop  rule  at  these  early  stages  of  experimentation  must  be 
rather  tentative  and  arbitrary ,  and  part  of  our  efforts  in  this  area  have 
accordingly  been  to  find  a  guide  by  which  such  a  rule  could  be  set,, 

D,  Random  Boost  Rule.— The  random  boost  rule  is  an  attempt  to  make 
use  of  information  which  the  Random  Restart  Rule  passes  by,.  Each  try  for 
a  solution  with  Oomory's  algorithm  establishes  a  lower  bound  to  the  ob¬ 
jective  function)  The  random  boost  rule  embodies  this  lower  bound  in  a  new 
constraint  which  is  pivoted  on  and  satisfied  before  ail  others  are  considered - 
Once  the  objective  function  attains  the  lower  bound  of  the  previous  solution 
attempt,  the  algorithm  proceeds  for  a  specified  number  of  pivots  and  then 
passes  along  a  po33.ibly  new  bound  to  the  next,  attempt 

There  is  considerably  aiailr  .-ity  between  this  rule  and  the  New  Con¬ 
straint  Technique  in  Section  4A  For  an  elaboration  of  the  mechanics  of  the 
procedure  s»e  the  disruvsior  -f  tin  latter 
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£..  laximum  Frequency  nitgible  hule. — The  haximum  Frequency  Eligible 
iiule  is  to  select  that  constraint  for  pivot  which  was  most  frequently  eligible 
in  the  past-  Its  use  was  suggested  by  experience  in  hand  testing  Gomory’s 
algorithm,,  where  it  was  found  that  an  excessive  number  of  pivots  was  often 
required  to  reach  a  solution  when  avoiding  a  constraint  consistently  eligible „ 
Fu  Cardinal  Learning  Pivot  Hale  .'-—This  rule  and  the  next,  the  ordinal 
learning  pivot  rule,  take  a  new  direction  in  pivot  choice  strategies.  They 
are  based  on  the  psychological  inode!  of  reinforcement  .Learning,  according  to 
which  the  organism  can  be  induced  to  acquire  a  systematic  pattern  of  behavior 
by  rewarding  certain  responses  and  punishing  others,  A  formal  structure  of 
multiple ’Choice  situations  has  been  developed-*/  which  has  already  been  applied 
out3.ide  psychology  by  Fischer  and  Thompson  in  the  construction  of  job  shop 
scheduling  rule 3. The  present  attempt  .is  to  extend  the  mode-,  to  the  process 
of  pivot  selection  in  integer  programming* 

The  mathematical  model  of  reinforcement  learning  posits  that  the  or¬ 
ganism  is  endowed  with  a  probability  vector  describing  the  likelihood  with 
which  ho  will  select  each  of  a  set  of  alternatives  put  before  him.  The  choice 
of  an  alternative  which  meets  with  reward  produces  a  change  in  the  probability 


vector  which  increases  the  chances  that  the  alternative  will  be  chosen 
Similarly v  a  punished  alternative  results  in  a  decreased  likelihood  th 
will  be  chosen  again* 


ram 


The  cardina:  learning  pivot  rule  is  designed  in  this  fashion  to  ; aware 
and  punish  good  end  bad  pivot  choices,  A  "good"  pivot  choice  is  defined  to 
be  one  which  produces  a  relatively  large  increase  in  the  objective  function; 

.  "bad"  choice,  similarly,  implies  a  11  small"  increase.  In  the  routine  wo  1  .  « 
used,  a  performance  record  is  kept  for  each  column  in  the  tableau,  measuring 
the  mean  contribution  to  the  objective  function  for  which  that  column  vns  re¬ 
sponsible*  (Other  criteria  of  performance  aro  c.f  course  possible:  for  instaj.ee 
the  maximum  objective  functioi  change  could  be  used  instead  of  the  .hv-»*v»  -r  r-1* 
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the  fractional  change  substituted  for  the  absolute,,  at  a  wore  refined  level, 
the  probability  ./eights  assigned  to  the  choice  of  coumns  wight  be  based  on 
the  trend  of  their  performance,  higher  priority  going  to  a  column  whose  per¬ 
formance  i.3  steadily  improving  than  to  one  whose  performance  is  deteriorating. 
An  additional  refinement  would  be  to  consider  columns  in  conjuntion,  gauging 
the  relative  merits  of  alternative  cycles  of  pivot  choice,.) 

The  particular  version  we  programmed  for  the  computer  .initially  seg » 
rebates  the  eligible  columns  into  three  groups:  (a)  the  columns  which  have  been 
chosen  for  pivoting  in  the  past,  (b)  those  columns  which  are  presently 
eligible  for  pivoting,  and  also  members  of  the  first  group,  (c)  those 
columns  which  are  presently  eligible  for  pivoting,  but  which  are  not 
members  of  the  first  group,, 

Associated  with  each  column  in  group  (a)  is  the  information  telling 
the  total  objective  function  change  due  to  pivoting  with  that  column,  and 
the  number  of  times  which  the  column  was  used  for  pivoting,,  From  this  the 
average  objective  function  change  due  to  choosing  that  column  for  pivot  is 
computed,  and  then  squared  fo  use  the  s  .uares  rather  than  the  means  them¬ 
selves  in  determining  the  probability  with  which  each  eligible  column  is  to 
be  selected  in  order  to  accentuate  the  difference  in  weights  assigned  to 
columns  with  good  and  bad  performance  histories.  The  probability  weight 
assigned  to  a  member  of  group  (b)  is  s imply  the  squared  value  for  which  it 
is  responsible.  Each  member  of  group  (c),  on  the  other  hand,  receives  the 
same  probability  weight,  which  is  equal  to  the  mean  of  the  squares  associated 
with  group  (a)-, 

Th'j  s  rule  is  called  the  cardinal  rule  because  each  column  which  has 
previously  been  pivoted  on  is  always  assigned  a  weight  determined  by  its  indi¬ 
vidual  history;  for  example,  column  number  7  will  be  considered  for  pivoting 
according  to  its  own  past  performance,  rather  than  on  the  fact  that,  from  left 
to  right  in  the  tableau,  it  is  at  present  the  third  of  the  columns  which  are 
eligible 


lo  represent  the  rule  precisely,  let  a,  b,.  and  c  denote  the  number  of 
columns  ..n  (a),  (b),  and  (e) ,  respectively,.  The  term  iir  will  denote  the  mean 
objective  function  change  for  which  column  1  is  responsible,  and  the  symbol  X 
a' ill  be  used  to  denote  the  set  of  all  subscripts  i  for  which  column  i  is  in  (x) 
Then  the  probability  p  to  be  assigned  to  selecting  the  eligible  column  k  for 
pivot  may  be  represented  as  follows , 


1  If  k£B: 


p,  -  m,  (  in.  t  (c/a) 2  m, 

*  k  k  .  ~  Q  i  '  '  ) 

1 1  3  j  •Tin. 


II  If  k  £  C: 

2- 

p,  (  (j  m.  )/  aws  where  <4  is  the  denominator  in  1  above, 
K  vMi  J 


G..  Ordinal  ^e.-.rnin;:  livot  hule.. — This  rule,  like  the  cardinal  rule, 
attempts  to  encourage  good  choices  with  reward,  and.  discourage  bad  choices 
with  punishment  (or  "negative"  re  ware) „  The  vehicle  of  reward,  positive  and 
.negative,  is  a  successively  redefined  vector  which  expresses  the  probability 
with  which  each  column  will  be  chosen  for  pivot  at  any  particular  stage  of 
the  algorithm*  Eligibility  acts  as  a  restrictive  operator  which  automatically 
assigns  /,aro  probability  to  those  columns  which  do  not  have  negative  indicators, 
and  calls  for  the  adjustment  of  the  other  probabilities  accordingly,,  The 
ordinal  rule  differs  from  the  cardinal  in  that  the  probability  assigned  to 
selecting  a  pm licuiur  column  for  pivot  is  not  dependent  solely  upon  its  own 
history,  but  ujen  its  ordinal  position  among  the  eligible  columns  in  the 
tableau.  That  Is,  we  will  be  more  interested  in  the  fact  that  a  column  is  the 
third  from  the  left  of  those  .»hich  are  eligible,  rather  than  its  precise  index 


in  the  tableau., 

t-3  it  is  true  of  the  cardinal  rule,  there  are  a  number  of  ways  in  which 
the  ordinal  rule  mi  ;ht  be  formulated  An  intuitive  version  would  be  to  estab¬ 
lish  an  "ordinal  probability  weight  vector"  containing  a  number  of  components 
e.-.ail  soir,;  nil,;  j  of  the  mu.bi  r  of  columns  and  keep  an  "ordinal  fishery" 


for  that  vector  .independent  of  the  performance  records  of  the  individual 
columns  - 

As  an  illustration.;  if  the  tableau  had  twelve  columns*  the  ordinal 
vector  sixty  components,  and  five  columns  were  eligible  for  pivoting,,  then 
the  probability  weight  to  be  attached  to  the  eligible  column  with  the  least 
index  would  be  equal  to  the  sun  of  the  first  twelve  components  of  the  ordinal 
vectorr  the  probability  weight  for  the  column  with  the  next  highest  index  the 
sum  of  tho  next,  twelve  components,,  and  so  on. 

When  the  pivot  was  executed (  the  result  would  be  recorded  by  maintaining 
two  supplementary  vectors,  one  to  keep  track  of  the  objective  function  changes* 
and  the  other  to  keep  track  of  the  number  of  pivots,,  if  the  third  of  the  five 
eligible  columns  was  selected,  the  objective  function  change  would  be  added  to 
each  of  the  amounts  in  columns  25  through  36  in  the  first  supplementary  vector* 
arid  in  the  second  supplementary  vector  the  same  columns  would  be  incremented 
by  one.  In  this  way  a  form  of  average  objective  function  change  could  be 
computed  to  provide  the  probability  weights  to  be  inserted  in  the  ordinal  pro¬ 
bability  weight  vector,. 

Tho  version  which  we  used  might  be  called  a  hybrid  ordinal  rule  in  the 
sense  that  the  supplementary  vectors  are  designed  to  associate  each  column 
with  its  own  history.  The  ordinal  weight  vector  itself,  however s  works  as  in 
the  preceding  illustration.  For  example,  again  suppose  there  were  twelve 
columns  in  the  tableau*  five  of  which  were  eligible.  In  this  case  the  ordinal 
vector  would  have  just  twelve  components,  the  same  as  the  number  of  columns  in 
the  tableau  Each  component  would  be  equal  to  the  (squared)  mean  objective 
function  change  due  to  pivoting  on  the  corresponding  column,  columns  not  pre¬ 
viously  pivoted  on  treated  the  same  as  in  the  cardinal  learning  routine.  Then 
the  probability  weight  to  be  assigned  to  the  first  eligible  column  would  be 
equal  to  the  sum  of  the  first  two  and  two  fifths  coiroonents  ,  the  probability 
weight,  for  the  second  eligible  column  e  :ual  to  the  sum  of  the  next  two  and  two 
fifth  >  components,  etc,. 
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To  represent  the  rule  precisely,  we  use  the  notation  used  to  describe 
the  cardinal  rule.  In  addition  we  define  (d)  to  be  the  set  of  all  columns,. 

(e)  to  be  the  set  (d)  -  (a),  and  (f)  to  be  the  set  union  of  ( b .)  and  (c)r 

be  let  v  =  if  i  £  Bs  and  v.  ~  (  /  m/’)/a  if  i  £  Let  •}*■  =  min(j:  j  £  F).. 

1  ;]  £  b  l1  .  i-t 

Then  let  ''  be  defined:  if  j  £  F  -  j*.  then  j’1  =  k  £  F„  such  that  k<  j,  and^i<,  j, 
i£  F,  then  i<  k,  Finally,  define  q.„  =»  int  (d/(b+c)  ),  r.„  =  d/(b+c)  -  q .  , 

j.,  — «  jw 

Then  the  probability  to  be  assigned  to  choosing  the  eligible  column  k  for 
pivot  .'nay  be  represented: 


1.  If  k  -  j*: 


V 

?k  ^ 
1®1 


Vf  f 


t  .  ,,  V  ,  m 

J-1  VT)- 


II.  II  It  /  j*: 

“lu  '  rk'L  (\,n> 

V  A 


'± 

'> 

Zaai 

i-,t.+2 


i  trk  v+i)/  S. 

j  .i  £  K 


where  r,  =  q +  r ...  +  r,  „ 
k  j*  k 


•L  ~  t’ui-  ic  °k  uc 


%  +  '  -*■ 


and  g,  =  int  (  q...  +  r...  +  r.  ,  -  1} 
k  —  j*  j-1*-  k* 

He  Largest  Objective  Function  Chan..a»“— The  name  of  this  rule  is  largely 
self-explanatory,  be  learned  while  working  with  problems  simple  enough  to  be 
solved  by  hand  that  we  often  got  close  to  the  minimum  number  of  pivots  by 
choosing  the  columns  which  individually  produced  the  largest  objective  fi.ncticn 
changes.  In  consequence  we  decided  to  test  the  rule  on  the  computer  with  more 
complex  problems  , 


because  of  the  fairly  extensive  computation  needed  to  apply  this  rule, 
it  must  result  in  a  fairly  small  number  of  pivots  to  compare  favorably  with 
say,  either  the  least  index  rule  or  the  random  choice  rule.,  In  fact,  in  the 
order  ve"ve  presented  them,  the  pivot,  rules  begin  with  the  one  r:ouirjn.;;  the 
least  amount  of  computer  time  on  any  given  pivot  and  extend  to  tiic  one  requiring 
the  most.  If  ail  are  to  compare  equally  well  in  respect  to  the  n-an  time 


required  to  solve  problems 


the  later  ruins  must  result  on  the  average  in 


fr. :  i.  •  than  t !; e  t.r liar  e.’ss,. 

i,  SJr t .X §  >1  Li XtiUi:-'! _  Tin  ouppiensnUay  tschniquu;:-  wore 

Hvolcyid  in  an  attaapl  to  got  a  start”  with  the  Simplex  before  app  i : 

Goiv.iy’s  all  integer  algorithm  >/e  felt  that  there  were  two  reasons  that  might 
make  sucJi  an  uttor.p1-  scrkl.while.  (l  '  us  problems  get  more  'Hff.lcu.lt,,  the 
number  cl’  pivots  r.:..juj.jod  by  the  s.uu.  Lex  method  coups  re  more  und  tore 
.. :  >;h  this  number  vesuired  by  the  all  integer  algorithm;  (•■’)  the  bu  cat  from  the 
s implex  c:>e*i hot!  ..ould  possibly  simplify  Hie  problem  so  that  exponent  rules  of 
choice  would  subsequently  work  as  well  no  more  sophisticated  ones,  cat  ting 
down  the  t ii; s  consumed  in  each  pivot  operation . 

A  He.-  Constraint  Technique  iftCTj  -  One  of  the  nest  conspicuous  and 
most  easily  u-.i.et  pie  y  n  of  Informatio ,  given  by  the  simplex  a.x-rci  it  h*a  is  Hj 
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The  irtit. 

Lai  pivots  with 

Gojsory  ”  s 

algorithm 

stv&int  until  it  ic  satisfied,  after  which  it  may  be  discarded  (it  can  never 
be  violated)  and  ti  e  pi’oblsir.  reverts  to  its  usual  form  The  motivation  for 
this  approach  was  the  expectation  that  (1.)  the  number  of  pivots  required  to 
satisfy  the  new  constraint  would  be  few,,  and  (2)  advancing  the  objective 
function  closer  to  the  solution  vicinity  may  result  in  fewer  pivots  being 
needed  thereafter,. 


The  NOT  can  be  represented  formally  as  follows,  h’e  refer  to  the 
standard  form  of  the  minimisation  problem:  "minimize  wb  +  b^„  subject  to 
wA  -  c  and  w  -  0,-"  Tne  new  constraint  i.s  given  by  wb  -  whore  w  / 

is  the  Simplex  solution  vector. 


u. 


0:13  appar-ent  advantage  of  the  NOT,  aside  from  its  simplicity*  is  that 
the  jff ort  put  into  the  simplex  algorithm  is  never  "lost" — no  matter  what  the 
form  of  the  problem,,  there  is  always  sufficient  information  to  form  the  new 
constraint.- 

B„  The  yew  Orlgjjy  Technique  (NOT)  o—-- The  WOT  is  the  most  effective  of 

the  strategies  in  this  report.  It  has  been  able  to  solve  62#  more  eight 

variable  eight  inequality  problems  within  a  400  pivot  cutoff  limit  than  the 

second,  best  rule  tested*  and  in  general  requires  from  40#  to  60#  fewer  pivots 

to  solve  those  problems  which  the  other  methods  were  able  to  solve  within  the 

cutoff  limit,-  The  WOT  uses  the  simplex  algorithms  and  in  particular  information 

obtained  from  a  tableau  prcciuced  at  some  stage  of  the  algorithm*  to  give 

starting  values  to  the  variables  before  applying  Gomory ''  s  algorithm.  Implicitly* 

Gomory's  algorithm  normally  takes  the  starting  values  for  all  the  vn  to  be 

zero .  To  express  the  condition  that  some  of  the  variables  begin  at-  other  than 

a  zero  value,  we  state  the  following  lemma, 

.Lemma  1,-  Given  any  vector  w^?  if  belongs  to  the  solution  set  of  the 

problem  "minimize  wb  +  b  +  w^b,  subject  to  wA  fe  c  w  A.  and  w  >  -  \P then  there 

is  3  w*  in  the  solution  set  of  the  standard  problem  "minimize  wb  +  b^„  subject 
.  10 

to  wA  *c  and  w  ?Q,‘!  so  that  w#  “  w  +  w  *  and  conversely. 

From  the  hypothesis,  w^A  *--c  -  and  £  -w^*  hence  (w^  +  w^)A  *c 
and  iV’  +  w°)  -  03  so  that  w"1'  t  \P  is  a  feasible  solution  of  the  standard 
protlen..  bince  minimizes  wb  +  b^  +  w^b  —  (w  +  \P)b  t  the  vector 

1  o 

(w  +  w  )  also  obviously  minimizes  the  function  wb  +  The  converse 
follows  by  considering  the  vsctor  (w#  -  :/*)„ 

0 

Customarily,  of  course,  w'  is  the  zero  vector.  In  what  follows  we  will 
attempt  to  compute:  a  some  of  whose  components  are  possibly  other  than  zero. 

„e  will  refer  to  this  computed  as  the  new  origin.  The  justification  for 
the  WOT  is  the  assumption  that  a  good  choice  of  an  initial  w^  would  reduce  the 
number  of  pivots  required  to  reach  a  solution  with  Gomory's  algorithm.  In  the 


extreme  ca'-Cj  .if  w  wore  an  integer  solution,  no  pivots  would  be  required., 
However,  a  bad  choice  of  would  mean  that  the  correct  answer  could  not  be 
obtained, 

Two  impositions  must  be  placed  upon  the  new  origin  if  a  correct  sol¬ 
ution  is  to  be  obtained  with  the  all  .integer  algorithm.,  We  embody  these  in 
Lemma  2,  To  insure  that  Oomory9s  algorithm  will  obtain  a  solution 

l  Q 

w"  (to  the  first  problem  in  Lemma  1)  so  that  (/  +  w  )  minimises  the  standard 
problem  (i)  the  components  of  must  ail  be  integer,  and  (ii)  each  com¬ 

ponent  of  w°  must  be  less  than  or  equal  to  the  corresponding  component  of  w*. 

If  (i)  were  not  true e  the  constraints  w  ■-  would  not  be.  permissible 
in  the  all  integer  tableau,  ,/e  note  that  these  constraints  in  the  new  problem 
are  not  to  be  coupled  with  the  constraints  w  .-1  0,  but  replace  them., 

To  see  the  validity  of  (ii),  wa  observe  that  in.  transforming  the  standard 

problem,  into  one  with  the  form  "minimize  wb  +  b^  +  vPb,  subject  to 
0  0 

wASc  w  A,  wf-*»w  , "  the  sar.o  result  is  achieved,  as  by  first  adding  the 

constraints  wj-*w^  to  the  standard  problem,  pivoting  on  them  before  all 

ethers,  and  then  ignoring  them.,  Hence  if  it  is  false  in  the  solution  to 

0 

the  standard  problem  that  w, for  some  i,  then  the  solution  obtained 

i.  J. 

by  Gomory's  algorithm  will  be  wrong  unless  the  ignored  constraint  is  viol¬ 
ated  in  the  proper  degree  during  the  course  of  pivoting,. 


Using  information  obtained  from  the  simplex  solution  of  the  linear 
programming  problem,  a  new  origin  vector  can  bs  derived  from  any  one  of  the 
simplex  tableaus.  In  order  to  describe  the  ensuing  derivations  straight¬ 
forwardly;  it  is  convenient  at  this  point  to  refer  to  a  form  of  the  simplex 
algorithm  which  solves  the  minii.dzat.ion  problem  directly  rather  than  as  the 


dual,  of  the  maximum 
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will  call  the  standard  representation  of  the  problem  -minimize 
••.b  +  1;^  subject  to  wAic  and.  w309  --Formulation  I„  The  initial  tableau 
for  the  version  of  the  simplex  algorithm  which  solves  this  standard  mini- 
miz.at.ion  problem  directly  is  3hown  in  (a)  below., 

Those  columns  in  the  tableau  (a)  which  are  eligible  for  pivoting  are 
negative  in  the  ~c  vector.  The  pivot  element  is  chosen  from  among  the  nega¬ 
tive  entries  in  the  selected  column  so  that  the  rows  of  the  tableau  will  re¬ 
main  lexicographically  positive  after  the  pivot,. 

For  additional  simplicity  we  denote  the  tableau  matrix  consisting  of 
-A  and  the  identiy  matrix  I  by  the  single  letter  A,  replace  b  and  0  vector 
by  b  alone,  replace  -c  by  and  extend  the  w  vector  so  that  it  includes  the 
slack  variables.  The  problem  can  then  be  rewirtten:  minimize  wb  +  subject 
to  wA  =  cs.  v.Z  0,  as  represented  by  the  tableau  (b),  V.’e  shall  henceforth 
refer  to  this  as  Formulation  II. 

The  simplex  algorithm  is  a  recursive  transformation  which  changes  each 
statement  of  the  problem  into  an  equivalent  statements  summarized  by  the 
subsequent  tableau,  with  the  same  solution  set  as  the  original.  Hence 
Formulation  II  is  perfectly  general,  and  (b)  ray  represent  any  of  the 
simplex  tableaus- 

(b) 


.e  will  abide  by  the  convention  that  b^!  denotes  the  vaxue  of  in  the 
f ina ■  c, implex  tableau.  Since  bQ'  is  the  (possibly)  fractional  solution  value 
of  the  function  wb  +  bQ  found  by  the  simplex  algoritb,  the  integer  variable 
solution  value  of  wb  +  b^  must  be  greater  tl.an  or  equal  to  b^’  rounded  upward. 
Using  the  notation  <^x)  to  denote  the  smallest  integer  greater  than  or  e  ,ual 
to  x,  wc  may  state: 


-A 

6 

1 

-c 

A 

c 
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Lemma  3 »  The  constraining  equation 

(1;  wb  =-■  ^  +  p 

is  true  for  some  integer  p-  0  for  the  integer  problem p  where  b  and  bQ  refer 
to  the  values  from  any  simplex  tableau.,  as  indicated  in  Formulation  II  „ 

(The  lemma  must  also  be  true*  of  course,  of  Formulation  I,) 

The  proof  follows  from  the  foregoing  remarks ,  since  .<ithout  requiring 

t  . 

that  the  variables  be  integral,  w  b  -  b^®  -  b^,  where  is  the  simplex 
solution  vector, 

Q 

is  now  proceed  to  the  main  derivation  of  the  new  origin  vector  w  0 


By  Formulation  If,  each  constraint  from  a  given  simplex  tableau  can 
be  written 


(2)LVk*°- 

Let  1  be  defined  by  a^/in  -  min  (a^b^)  for  all  k  such  that  not  both  and 
bj.  are  zero  By  convention  a^/0  -  - <(  0  and  a^/0  -- if  >0, 
it  is  assumed  that  i  is  unique, 

Let  H  -  min  (a^/b^)  for  all  k  j-  i,  excluding  a^/b^.  --  0/0,  './e  immediately 
state  the  following  lemma, 

Lemma  4-  Provided  H  jf  *■'  ,  (i)  Hb^  -  a^isO  if  k  i:  (ii)  Hb^-  a^>0„ 

V’e  note  that  part  (i)  holds  trivially  if  and  are  both  aero  If  we 

assume  otherwise,  the  first  part  then  follows  from  the  fact  that  a^/b^  if 

k  r  i,  By  hypothesis  H  ■/<**',  and  since  i  is  required  to  be  unique  p  H  f 

Thus  j  0  for  ail  k  such  that  f  0,  But  by  the  simplex  algorithm* 

b^*0  for  all  k„  hence  b,.,>  0  for  all  relevant  k„  Hb^.  ^.vaj^/b^)  and 

Hb,  ~  a,  ^  0„  Similarly,  Kb.  -  a. >0  follows  from  the  fact  that  a. /fa.  <  H, 
it  k"  ii  i  i 


ne  will  use  Lemma  4  to  derive  a  permissible  value  for  the  component  w 

0 


i 


of  the  new  origin  vector  vi  ,  Kewriting  equation  (l)  as  a  sum  of  variables  and 


multiplying  both  sides  we  obtain 
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~  where  B  is  defined  by  B  =<fb^  '  y  bQ  +  p„ 

Bubtacting  (2)  from  (3)  gives 

S’  w,  (Kb,  -  a,  )  =  HB  -  c 
.L  k  k  1: 

:.e  transpose  for  k  I  ij  and  invoke  Lemma  4  to  obtain 

(Kb.  a.)  w.  =  HB  -  c  -  S  w  ( Ifb,  -  a,  )£  HB  c> 

i  i  i  k  k  k  k 

Again,  since  Hb.  ~  a.  >()„ 

a  ID. 

(4)  v.  >'HB  -  cJ/fHbj  -  a.) 


.from  which  we  can  infer  a  permissible  value  for  w.  „  If  we  further  define  j 

by  ~a,/b.  -  min  (-a^/ty)  for  all  kP  and  Q  =  min  (-a^/b^)  for  ail  k  ^  j, 

(again  excluding  a  /b.  =  O/O)  we  can  state  the  following  theoi’em,  the  first 
IT  K 

part  of  which  we  have  just  proved. 


Theorem  1,  whenever  the  following  expressions  are  well-defined  end  greater 

than  or  equal  to  aero,  permissible  values  for  the  components  w. ^  and  w.°  of 

i  j 

r\ 

the  new  origin  vector  v^are  given  by 

ii)  w.(;  «  /(HB  c)/(Hbi  -  a.)) 

(ii.)  w/  =  (//b .  if  H  ~  o'® 

(iii)  w.C  =  +  c/- 

Part  (ii)  of  the  theorem  follows  from  the  fact  that  if  H  then 
'•  0  for  all  k  f  i.  Hence  equation  (l)  reduces  to  va "^O  +  P  = 
and  for  the  strictly  correct  value  for  p,  w_^  =  B/b^,  he  write  this  in  the 
fora  (ii)  since,  as  we  will  show  later,  it  may  suffice  to  give  p  a  value 
slightly  lower  than  the  one  required  to  make  equation  (1)  an  identity  for 
the  all  integer  solution  vector  v.  ~  VJ#,  The  case  for  b^  =  0  is  omitted  since 
b,  =  0  for  all  k:  which  makes  the  objective  "minimize  wb  +  b,."  meaningless 
For  this  reason  q  —  <^io  also  excluded  from  consideration,.  The  derivation  of 
fill)  begins  with  £ (  a  )«k  =  ~c  in  place  of  equation  (2),  The  remainder  of 
the  derivation  is  a  duplication  of  that  of  (l)t  with  ip,  j?  ”ajc"  snt^  "c  su^ 
sit vied  for  I!,  i-  a.  .uid  c  Thus  ur.  get  v.  2(wB  *c)/  (wb^.  +  ay  as  the 


jl6 


conn  L.n.  art.  rf  !A.'.  He., 'five:-,,  from  the  knowledge  that  each  constraint  contains 

a  v,a .  ..olo  ;  ..•«  cau  conclude  that  Jidn(-a, /b.  )=  ~l/0,  and  -<b,  +  a.  =  1, 

k  k  JO 

Part  (iii)  follows  ;md  the  proof  of  Theorem  1  is  complete-  V/o  remark  that  any 

component  of  the  new  origin  vector  which  is  left  undetermined  by  the 

equations  or'  Theorem  1  is  automatically  assigned  the  value  zero-  If  a  component 

of  „  ^  it  determined  to  have  different  r on- zero  values  by  several  constraints, 

it  in  reasonable  to  assign  it  the  largest  of  the  values.. 

ior  a  given  constraint,  it  is  not  always  necessary  to  compute  both 
0  -0 

w.  ena  w,  .  as  ine  iolxowine  ixAUstratos., 

i  ,i 

The  even  Z  irovided  H  4  ,  (i)  .i.f  w.S’O,  then  w.^  =  0,  and  iii)  .if 

J 

h-/>0r  w.  -  0:  To  prove  this  .m  first  prove  the  following  two  lemmas 0 
B*0.. 

J:efl®a  6^  It  H  /-  then  y  £  i. .. 

tearaia  5  follows  by  recalling  the  definition  B  P»  P-0 

(p  integer),  and  noting  that  the  simplex  algorithm  increases  the  value  of 

b„  mc-uc- toniual.lv  so  that  b  ‘  >  b,,., 

0  o  -  0 

In  Lemma.  y(  *4i  a  /b  for  some  subscript  m  other  than  i„  Jince 
w  m 

-v.  -  min  (-a./b,  )  foi.  -.*11  k  ZJ  i,.  V. £  -H  unless  m  ~  j.  But  then  H  =  a./b.  =1/0  =«^- 
2‘-  n  -  J  J 

rL o  prove  (i)  of  Vheortva  2,.  we  note  that,  since  Jftn  «  a  ^  ,> 0 ,  if  = 

('  IS;  c)/(Kl,  then  HB  c  >  0..  Thus  -HB  +  c  ^0,  and  since 

•!!  and  B /  0,  v,P  ■■■  a  £  -Hit  -r  c  { 0,  from  which  =  0  follows  at  once..  The 

proof  of  (it)  proceeds  similarly ,  It  nay  parenthetically  be  remarked  that  the 

provision  H  (■<>'"’ in  Th eoren  2  is  more  restrictive  than  necessary#  oince 

K  =  u.  /b  •-  min  ‘1.,/b.  )  for  l:  4  i,  H  implies  a./b.  -/for  all  k  other 

than,  k  -  i  and  k  =  r,.„  provided  not  both  end  bj  equal  zero,.  Hence  if  then 

is  .3.0  index  n  for  which  a  4  0,,  n  4  m,  n  f  i,  then  a  /b  -  a  /b  -cf3  .  and 

toe  subscript  ,j  defined  by  a./b.  =irin(-ayb  )  for  all  k,  is  nonunique, 

-3  j  K  K 

hence  v; -  0  by  default 
0 


17 


the  last  remark  defines  the  limit  to  which  Theorem  2  may  be  strengthened* 

it  Is  not  true,,  for  example,  that  at  least  one  of  w.°  or  w  ^  must  be  positive* 

i  J 

~f  zero  is  the  only  permissible  value  for  there  is  no  guarantee  that 

c 

w.  will  be  any  better* 

J 

In  order  to  use  Theorem  1  to  derive  a  new  origin  vector  w^„  it  i3 
necessary  to  find  an  acceptable  value  for  p*  We  note  that  (l)  must  be  true 
for  the  integer  solution  vector  w  =  w*,  and  >;e  obtain  the  defining  equation 


'5)  p*  “  w*b  +  b0-  O0’) 


if  b  and  are  taken  from  the  initial  tableau,  it  can  be  seen  that  p*  repre¬ 
sents  the  difference  between  the  objective  function  value  for  the  all  integer 
solution  (t#b  +  b  )  and  the  objective  function  value  for  the  solution  with 
the  simplex  algorithm  (b^’  =  w"b  +  b^,  the  simplex  solution  vector),,  where 
the  latter  has  boon  rounded  to  its  next  highest  integer,,  While  p#  is  the 
one  strictly  correct  value  for  p,  if  H  ( 0  for  all  the  constraints  for  which 

»nu_>  0n  the  only  danger  is  ir:  choosing  p  too  small,  since  only  then  would  the 
0 

»n  bo  larger  than  implied  by  the  correct  value.  The  same  is  true  of  Q  and 
G 

the  w,  ,  Conversely,  for  H  or  w/0.;  the  risk  is  in  choosing  p  too  large* 

J 

It  is  fortunately  possible,  by  being  systematic,  to  reduce  both  cases 
to  one*  Goraory s  algorithm,  like  the  simplex  algorithm, produces  a  new  ob¬ 
jective  function  value  in  piece  of  the  original  with  each  successive  pivot* 
for  any  specified  tableau  obtained  by  CJomory's  algorithm  we  will  denote  the 


current  objective  function  value  by  B^* 

The  procedure  is  to  begin  with  p  ~  0 ,,  determine  tne  w, ^  and  w  ®  and 

1  J 

start  Gomory's  algorithm*  There  will  be  some  cutoff  value  for  which,  if 

transcended,  will  indicate  that  the  choice  of  p  was  unsafe  and  that  the 

anc!  w  ^  need  to  fca  revised.*  At  this  point  p  is  incremented  by  an  appropriate 

amount,  the  new  w.^  and  w.^  determined,  and  the  process  repeated*  The  process 

J 

can  be  formulated,  precisely  as  follows 
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The  NOT  Procedure: 


fa)  Lai  pQ  =  0 

(b)  Determine  the  new  origin  vector  vP  on  the  basis  of  p  =  p^.. 

(c)  Determine  the  least  integer  Pq  wuch  that  assigning  p  the 

value  will  yield  a  different  value  for  some  component  of 
w°  than  by  giving  p  the  value  pQ.. 

(d)  Apply  Gomory'  s  algorithm  to  the  problem  "minimize  wb  +  ■>  w% 

subject  to  wAilc  -  w°As  w  £  -w "where  b,  b  ,  a,  and  c  are  from 
the  initital  formulation  (see  Formulation  I,  page  13). 

fe)  Let  represent  the  current  objective  function  value  taken  from 
a  specified  tableau  for  the  problem  in  (d).  If,  after  any  pivot,, 
Bq  ?  +  P^-’  aive  Pq  valus  and  begin  again  at  (b)L 

(f)  If  the  condition  in  (e)  is  not  satisfied,  was  suitably  choseno 

The  objective  function  value  BQ  ~  bQ2  and  the  values  of  the 

variables  vk  displayed  in  the  final  tableau  to  the  problem  in 

(d)  are  the  solution  values  for  the  standard  problem  "minimize 

wb  +  b  subject  to  v/A £  c ,  w£.0.!l 
u 


>'e  remark  first  on  the  second  statement  in  (f)„  Let  w“  denote  the  all 

integer  solution  vector  to  the  problem  in  (d).  Under  the  assumption  that  \P 

is  suitably  choso,  we  have  shown  that  A  +  vP  is  the  all  integer  solution. 

vector  to  the  standard  problem  in  (f)„  The  objective  function  value  =  b^* 

given  by  the  final  Gomory  tableau  for  the  problem  in  (d)  satisfies  the  equation 

b  J-.-  --  iA)  +  b  +  w°o  (w1  +  w°)b  +  b,.  and  hence  is  the  solution  value  for  the 
0  0  d 

0 

objective  function  to  the  problem  in  (f)..  The  effect  of  the  constraints  w„,  -w 
in  the  initial  Gomory  tableau  is  to  replace  the  zero  vector  beneath  the  -I 
matrix  for  the  standard  problem  with  the  vector  w  „  This  "starts"  each  w# 
at  w.°  rather  than  at  0,  so  that  the  final  w  vector  read  from  the  tableau  is 
(Vi-  \P)  rather  than  W  ,  as  the  second  part  of  (f)  claims 
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■v'e  will  now  prove  the  validity  of  the  NOT  procedure  with  the  following 

theorem 

Theorem  3-  Assume  that  the  NOT  procedure  has  been  applied  specified  above, 
(ij  If  Bq> {boy>  +  p^,  then  the  strictly  correct  value  of  p,  p*£p^., 

(ii)  If  <  \by^)  +  p.( ,  then  p  £  p*£p^,  and  by*  is  the  correct  objective 
function  solution  value, 

No  first  prove  Theorem  3  under  tha  hypothesis  Py!“p*, 

To  prove  (i),  suppose  p*/  p..  ?  By  the  defining  equation  ( 5)  of  p*s 
w*b  +  by  -  (  byt)  <  p.  j  and  hence  w*b  +  by  <(  {h^  y  +  p^c  Applying  the 
hypothesis  of  (i)  to  this  last  equation  we  get 

(6)  K*b  ^  by  {  By., 

But  if  Py  £  p*  ^  p, f  then  the  choice  of  Cy  determines  the  same  vector  as  p*.r 
Therefore?  as  we  have  remarked,  Gomory’s  algorithm  applied  to  the  problem  in 
(cl)  of  the  NOT  procedure  must  display  the  correct  solution  to  the  problem  in 
(f)  In  its  final  tableau..  Since  the  algorithm  increases  the  current  objective 
function  Dy  mono  tonic  ally  with  each  pivot,,  By£w*b  +  by,  contradicting  (6)» 
Consequently  p*> 

For  (ii)  we  suppose  p* ?  p^„  Than  from  15),  w*b  +  by  - 
and  w*b  +  b  '?  <b„'}+  p,  .  By  the  hypothesis  of  (ii)  this  yields  w*b  +  b_  >  b  *„ 

0 r  \  U  /  1  U  U 

or  i.n  other  words  the  integer  objective  function  value  associated  with  a 
.feasible  solution  (w  r  *“')  to  the  problem  in  (l'j  is  smaller  than  the  minimum 
objective  function  value  w*b  +  by,  which  i3  impossible .  The  conclusion 
P’  £p,  follows., 

* 

To  prove  the  second  half  of  (i.i)  we  note  that  if  PySp^p^o  then  Py 

Q 

determines  the  same  w  vector  as  p*  and  by*  is  the  correct  objective  function 
value  of  (f).  On  the  other  hand,  if  p*  =  p^,  then  by  the  same  sequence  of 
reasoning  as  .in  tho  preceding  paragraph  by*£.  w*b  +  bQ,  and  hence  bQ*  =  w*b  +  bQ 
corif inaing  that  b  *  is  still  the  correct,  solution,  and  (ii)  is  true. 
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V.'he  complete  proof  follows  the  preceding  pattern  inductively  by  starting 

as  in  the  HOT  procedure  with  -  0.-  For  this  the  hypothesis  p*7  p^  is  satisfied. 

and  the  proof  of  (i)  shows  that  p*>  must  continue  to  hold  as  long  as  the 

NOT  procedure  is  iterated  according  to  instruction  (e), 

The  validity  of  ths  WOT  procedure  follows  immediately  from  Theorem  3 

since  by  (i)  is  is  assured  that  the  condition  in  (e)  will  not  be  satisfied 

unless  the  procedure  can  subsequently  find'  a  value  for  p^  which  will  produce 

the  same  w°  vector  as  p»,  and  by  (.ii),  it  is  assured  that  the  procedure  will 

stop  with  b^k  equal  to  the  correct  objective  function  value. 

The  question  arises  as  to  which  simplex  tableau  gives  the  best  new 

origin  The  final  one  seems  a  logical  choice  since  in  the  immediate  vicinity 

of  the  simplex  solution  the  only  variables  which  must  have  positive  values 

will  oe  in  the  simplex  basis..  As  p  grows  larger,  however,  the  possibility  of 

new  varr.ab.les  becoming  implicitly  nonzero  will  increase-.  In  the  actual  tests 

issue  winh  the  NOT,  both  the  initial  and  final  tableau  were  used  to  generate 
0  0 

the  w.  and  vr  and  the  values  compared,, 

It  night  be  guessed  that  since  each  tableau  implies  ths  same  solution  set, 

0  () 

the  values  for  the  w.  and  w.  would  be  the  same  regardless  of  which  tableau 

i  ,1 

was  selected  fox'  their  derivation,.  Interestingly  enough,  this  supposition  is 
wrong.  It  is  even  possible  to  construct  problems  for  which  the  values  of 


Q 

some  o.i  the  components  of  w  are  worse  from  a  later  tableau  than  from  an 

earlier-  one  A  uniformity  that  does  hold,  however,  is  that  for  the  constraint 

used  a;,  pivot  the  i  end  j  subscripts  of  w.^  and  w,^  switch  values „  and  the  new 

w.°  equals  the  old  w . ^ ,  „nd  vice  versa-.  The  proof  of  this  is  given  in  Appendix  B„ 

.1  1 

There  is  additionally  the  question  of  whether  the  NOT  ought  to  be  used 
to  assign  positive  values  to  the  slack  variables.  The  argument  against  assigning 
values  to  the  slacks  is  that  this  increases  the  requirements  to  be  met  by  the 
nonsiacks,  In  consequence  it  becomes  more  Likely  that  too  large  a  value  for 

the  objective  function  will  be  implied  On  the  ouln.r  hand,  positive  slack 
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values  may  speed  up  Gomory'a  algorithm  if  they  are  nearly  correct.,  The 

question  here  ties  in  closely  with  the  question  of  the  new  origin  technique 

and  feasibility,  soon  to  be  discussed  Only  practice  can  decide  the  matters 

■and  tests  of  the  relative  performance  of  the  NOT  under  the  two  methods  were 

conducted  as  part,  of  the  experimentation  procedure.. 

The  NOT  and  Feasibility,  —-Problems  exist  for  which  the  NOT  is  unable 

0 

to  reach  the  minimum  solution,  using  permissible  values  for  the  wl  and 
w.^,  within  a  reasonable  number  of  pivots,.  For  some  of  these  problems  the 
NOT  can  be  modified  to  find  a  solution  which  satisfies  all  the  constraints., 
even  though  it  may  not  give  the  theoretical  minimum  To  accomplish  this  it 

is  necessary  uo  relax  the  restrictions  on  the  permissible  values  of  the 

0  ,  0 
w .  and  w .  „ 

J-  J 

..hen  the  objective  function  reaches  the  cutoff  level  B^y/b^r  p^ 

which  signals  that,  y  was  not  safely  chosen,  instead  of  indicating  a  return 

to  instruction  (b)  and  a  revision  of  the  w°vector,  the  MOT  procedure  allows 

Gomory,1a  algorithm  to  persist  for  a  specified  number  of  surplus  pivots.  An,. 

solution  found  will  be  feasible,,  and  can  be  recorded.  Thereupon  the  MOT  is 

set  back  on  the  course  it  would  have  followed  if  no  digression  had  occun*ed„ 

3c  long  is  feasible  solutions  are  permitted,  it  is  expedient  to  go  one 

step  farther  and  allow  the  initial  value  of  to  be  the  negative  quantity 

b.,  This  effectively  makes  the  first  val.ues  for  the  components  of 

0  0 

w  r  when  w  is  derived  with  respect  to  the  final  tableau,  the  same  as  the 
values  of  the  variables  in  the  simplex  solution,  rounded  upward., 


5 «  bo-lGd  OF  k.Miili-lNTl  ,111)  l.Ki  IldtAL  jiflULTo „ 

The  bulk  of  the  problems  on  which  the  pivot  rul-.B  and  supplementary 


techniques  were  tested  consisted  of  eight  variables  and  eight  inequalities. 
The  objective  function  vector  was  randomly  generated  from  the  integers  1 
through  29,  and  the  absolute  values  of  the  coefficients  of  the  constraint 


randomly  5anerat.ec]  with  range  0  to  29  Each  entry  in  the  A  matrix 


vn:.*  .roles 


a;  :f  : .  -•  "  vector  i.  ri.-3  to  the  notation  of  Formulation  1.  page  34)  was  made 

iv  .hi'.  1  ■  :o.-. -.u.' :  i.y  ,  The  x:  ■solute  ues  of  >.  h.  e  vector  components 
••am’cs.ly  bet  .ear,  0  «ud  59  hroblesra  which  turned  out  to  have  no  feasible 
.-x  .’.j-' Jo;:  have  been  amiltrd  from  the  following  discussion.. 

;:«c  ’Uo.v  tlie  re  •  idem  pivot  rule  was  used  with  the  supplementary  techniques, 
;u.J,  because  tie:,  occurring  ’ivler  other  pivot  rules  for  the  choice  of  the  pivotal 
«<.  :r-‘  tv  Lot  we  io  broken  ly  ri  »dom  sale 'to  on.,  we  have  tested  each  rule*  four 
t  i.ns:.-  on  each  problem  by  altering  the  random  number  base,  The  .first  negative 
Ju  dies  ter  rule.,  which  has  no  random  element,  is  of  course  excepted..  An  upper 


ci;  .iff  w.13  apjlied  uniformly  to  all  the  rales  so  that  no  problem  was  allowed 
to  ran  fox*  mere  than  400  pivots  on  any  trial# 

?c.r  purfcssr  of  comparing  the  performances  of  the  rules,  four  consider 
n!.  v  relevant  ;-.rr;.:  yed  in  dee  sending  order  of  importance,  they  are: 

;  I  ,  niiv’.vr  of  tnf .« rone  problems  that  a  rule  solved  at  least  once,  (2) 

*,h‘  total  r’ri :.'S‘  of  hv<  cupful  r  . flu1; ten  attempts,  (3)  '..he  mean  and  standard 
do  1  i  •  fc  L ;  1  •  f  th-:  t.v re  direct  vo  :  t  ..  -olutior.,  (4)  the  mean  and  standard 


de.T.Um  of  the  n-"a.>er  tf  pilots 


a  '  uxrei  00  reran  a  aoxunaon. 


the  rule.,  wr.-e  1c:;  Jed  on  sixty  -eight  problems  (  with  decisive  results 
..n  spits  of  the  sir. pi-'  city  of  the  pcob:.erno  no  rule  except  the  NOT  was  able 
io  sji-‘8  over  half  of  i l.c.-.-i..  the  s>  d  best-  rule,  the  Largest  Objective 
Function  Change  del  5,  succ*  s.fu :  iy  solved  inly  12  of  the  65  problems  (474) 
ah  least  rxe,  The  ii07,  by  compnriscr:  solved  52  problems  {lh%).  By  allowing 
frirflbjo  solutions  not  nrettsarily  the  rx.nJ.nium.  the  power  of  the  NOT  was  ex 
further,  en>.bJ ii-.j  It  t.u  give  •riswers  (not,  necessarily  optimal)  to  63 


?  •  Oi 


bur  prci:lt  ;,"-i 


^ii3r"..'-]’or', u  tin?  cit e.  '. - tj  t. *  ''ruir'  will 
t-.ie  ucppicmeiiL ary  techniques 


refer  both  to  the  pivot  rules  and  to 


In  contrast  to  the  wide  difference  between  the  NOT  and  the  Largest 
Objective  function  Change  Rule,  the  remainder  of  the  rules  differ  from  each 
other  by  much  smaller  degress ..  the  ranking  along  the  four  scales  becoming 
mixed.-  Interestingly,  the  rules  were  very  nearly  unanimous  concerning  the 
problems  they  failed  to  solve  -  Exactly  half,  or  34  of  the  68  problems,  were 
unsolved  by  any  of  the  rules  other  than  the  NOT,  The  24  problems  solved  by 
tiie  Random  Boost  Rule,  which  was  the  worst,  were  also  solved  by  all  the 
others,  and  the  29  solved  by  the  Ordinal  Learning  Rule  included  only  two  not 
among  the  ,31  solved  by  the  Maximum  Frequency  Exigible  Rule.,  No  other  dis 
crep&ney  was  greater  than  this., 

There  were  somewhat  larger  deviations  among  the  totals  of  successful 
solution  attempts,  and  reversals  of  ranking  were  not  uncommon.  While  the 
Maximum  Frequency  Eligible  Rule  solved  2  problems  more  than  the  Ordinal 
Learning  Rule,  it  had  3  fewer  successful  solution  attempts. 

Table  I  summarizes  the  information  on  the  decision  rules  as  they  were 
applied  to  the.  68  problems. 

The  data  on  means  and  standard  deviations  of  times  and  pivots  required 
to  obtain  solutions  nay  sometimes  appear  to  run  counter  to  expectation. 

There  are  three  reasons  for  this..  First .  for  those  rules  that  require 
evaluation  of  all  eligible  columns  before  selecting  the  column  to  be  used 
for  pivoting,  the  number  of  columns  eligible  in  a  tableau  will  make  a  difference 
in  the  time  required  to  carry  out  a  complete  pivoting  operation,  thus  causing 
the  data  for  times  to  correspond  inexactly  to  data  on  pivots..  Second,  times 
were  recorded  by  the  computer  only  to  the  nearest  second.  M  ans  and  deviations 
comd  be  reduced  or  increased  according  to  the  direction  in  which  various 
times  were  rounded..  Third,  or  most  of  the  rules,  those  problems  which  Comory  s 
algorithm  was  able  to  solve  'were  solved  with  a  mean  ol  from  30  to  35  pivots. 
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I'a  tally  ■'■()/.  or  more  of  the  successful  solution  attempts  were  accomplished  in 
her  a  th-'i'  %•  pivcau.  and  mo  t  of  the  rest  in  less  than  60  pivots  However,  about 
3$  to  5$  of  the  successful  solution  attempts  required.  150  to  200  pivots  *  The 
.'’rational  extreme  numbers  of  pivots  have  produced  standard  deviations  that 
seem  unreasonably  large  Oince  the  mean  times  were  generally  l/3  to  1/4  of 
tha  mean  pivots,  the  effect  of  extreme  times  was  not  proportionately  'so  great 
an  influence  on  the  standard  deviations  as  the  extreme  number  of  pivots, 

Li  is  also  possibly  of  interest  to  note  that  those  problems  which 
required  ever  150  pivots  cn  one  solution  attempt  were  often  solved  in  con¬ 
siderably  fewer  pivots  cn  another  attempt-  As  a  .rule v  any  problem  solved 
war.  soivo,:  at  least  or.ca  in  3'0  pivots  cr  less, 

•fiie  data  fo:  the  NOT  is  divided  into  three  parts  in  Table  I,  The  first 
Cor?,,  designated  "h’OT  Feasible,1’  refers  to  all  problems  for  which  the  NOT 
ob'.si.rsd  a  solution,  whether  or  not.  the  solution  w.„s  optimal.  The  second  part., 
di-si s-t itud  simply  ' HOT  11  r<3 f era  only  to  '.hose  problems  for  which  the  NOT  did 
obuau  the  optimal  soluti «.i  i and  guv;  notice  of  the  fact)..  The  third*  called 
■•t'Oi  L-str: u-tsd,"  refers  to  the  'Am  'Jrigj.n  Technique  restricted  to  the  34 
problems  i/nich  v.ero  solved  by  at  least-  one  of  the  other  rules.  The  data  for 
th*  «>ud  s.art  chews  that  the  NOT  fvnuwi  the  problems  solved  by  the  other  rule3 
an  >i;g  ih»  cu.O-:.er  cues  to  handle 

t  mould  be  voted  t  hus  tne  20!  was  always  used  in  the  form  that  seeks 

feasible  solutions  hence  the  actual  number  of  pivots  allotted  to  solving  for 

the  thecu'o ideal  n-irimum  was  somewhat  .loss  than  4(X)  •  On  the  other  hand,  the 

figure.*;  for  the  pivots  are  based  on  the  number  of  pivots  required  by  the  NOT 
* 

,s;i s  !  s  -:r -i-itct  or  l  ast)  aoiur.j on  the  first  time,  though  the  solution 
h.  ; rat  remit  war.  possibly  only  registered  feasible, 

T..en:.y,  foruy  and  eighty  surplus  pivots  were  tested  for  the  NOT  in 
i’.uritjivg  feasible  solutions,  with  at  the  most  a  slight  advantage  to  the  eighty 
o.iriauu  ilvots  mark  'Jm>  reason  for  this  seems  to  be  that  the  larger  the 


values  for  the  new  origin,  tho  more  quickly  a  feasible  solution  was  reached,, 
whether  a  good  one  or  a  bad  one,  30  that  earlier  revision  of  the  w.^  did  not 
produce  either  defect  or  advantage  for  small  values  of  p«  Furthermore, 
Comory's  algoi-itlua  often  seems  to  obey  the  principle  whereby  it  either 
solves  a  problem  in  a  fairly  small  number  of  pivots,  or  not  at  all„  as 
already  pointed  out,  there  problems  that  did  require  a  fairly  large  number 
of  pivot 3  on  one  solution  attempt  were  usually  solved  in  fewer  pivots  on  the 
otter  attempts 

The  Random  Restart  Rule  and  the  Random  Boost  hule  were  similarly  tested 
with  upper  cutoffs  at  30,  50,,  and  70  pivots,  with  no  significant  difference 
in  results,.-  For  example,  using  the  50  pivot  cutoff,  a  problem  solved  on  the 
first  try  in  45  pivots  was  generally  matched,  using  the  30  pivot  cutoff,  by 
solving  it  on  the  second  try  within  10  to  20  pivots*  The  Random  Restart  Rule 
scsentailly  multiplied  the  solution  attempts  of  the  Random  Pivot  Rule,  adding 
further  evidence  that  Gomory  s  algorithm  by  itself  was  not  suited  for  the  34 
problems  unsolved,  by  any  of  the  rules  except  the  NOT.. 

Additional  Results  for  the  HOT, .-"The  form  in  which  the  NOT  was  pro¬ 
grammed  for  the  68  problems  referred  to  in  Table  1  did  not  assign  values  to 
the  slack  variables-  Thirty  additional  problems  were  tested  with  the  NOT, 
using  an  upper  cutoff  of  200  pivots  and  four  solution  attempts  for  each  prob¬ 
lem,,  two  bv  assigning  values  io  the  slacks  and  two  not..  For  these  problems „ 
it  appears  that  assigning  values  to  the  slacks  which  are  close  to  their 
correct  ones  does  not  help  the  algorithm  to  reach  a  solution  any  more  rapidly* 
Tills  implies  that  the  algorithm  would  have  comparable  difficulties  solving 
a  problem  for  which  the  simplex  gave  an  integer  answer., 

On  four  of  the  30  additional  problems  the  use  of  slack  assignments  pre¬ 
vented  the  algorithm  from  rescuing  feasible  solutions  as  good  as  those  reached 
by  the  NOT  in  the  form  in  which  it  ignored  the  slacks.  On  the  oilier  hand,  the 
NOT  without  slack  assignments  was  always  at  least  as  good,  both  ,.n  terms  of 
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solutions  obtained  and  in  pivots  required  to  reach  them,  as  the  NOT  which 
gives  values  to  the  slacks,  though  generally  there  was  no  notable  difference 
between  the  two. 

In  addition  to  the  study  of  slack  assignments,  an  examination  was  made 
of  the  comparative  merits  of  the  initial  and  final  tableaus  for  producing  new 
origins-,  Records  kept  of  the  new  origin  values  obtained  from  the  initial  and 
final  tableaus  with  the  WOT  indicate  that  the  latter  were  generally  far  superior 
as  expected  Eecau .e  of  this  double  computation  of  w^c  however,  the  times 
recorded  for  the  NOT  are  slightly  distorted,  Jt  should  particularly  be  noted 
that  the  times  for  problems  solved  by  the  NOT  in  ohly  a  fav;  pivots  may  be  mis¬ 
leading  since  the  evaluations  made  before  the  start  of  Garnery’ a  algorithm 
are  the  most  extensive, 

A  record  of  the  lower  bounds  established  with  the  HOT  did  not  always 
prove  helpful  in  determining  how  large  the  deviation  from  the  actual  minimum,; 
if  it  existed  might  be,.  In  two  cases  the  difference  between  a  feasible  solu¬ 
tion  and  the  lower  bound  was  reduced  to  less  than  five,  yet  there  was  no 
indication  that  the  minimum  had  been  obtained.  At  the  opposite  extreme, 
eight  of  the  problems  which  were  solved  correctly  differed  by  as  much  an 
4 0%  from  the  lower  bound  <.  t  the  point  where  the  correct  solution  was  first 


signalled  feasible 

Table  II  has  been  designed  to  show  the  workings  of  the  NOT  in  me  ‘3 
detail,  The  four  problems  'referred  to  In  the  table  arc  not  represents.!’  vs, 
but  were  chose  to  illustrate  some  of  the  variation  in  the  results  obtained 
by  the  NO'Tc  The  rows  under  each  problem  heading  show  the  pivots,  the  i'.me, 
the  values  of  the  the  solution  values  of  the  variables ,  ana  the  ob;je  .! 
function  value  for  each  feasible  solution  reached  in  succession  on  a  given 
trial.  The  new  origins  which  have  r.o  o'-’-hcr  ''nfonu  tic  a  recorded  ,.ith  ..hem 
were  not  used  successfully  to  reach  a  solution. 


\ 

\ 


One  trial  only  ir.  illustrated  l'or  problems  1  and  2,  while  two  trials 

are  shown  for  proolems  3  and  1  J  rc-blsm  2  is  the  only  one  of  the  four  for 

which  the  WOT  obtained  the  Minimum  solution  and  recorded  the  fact,.  The  most 

we  know  of  the  solutions  for  the  other  problems  is  that  they  are  feasible,, 

The  pivots  for  the  NO?  shown  in  Table  II t  unlike  those  for  the  NOT  in 

Tables  J.  and  II,  do  not  include  the  pivots  required  initially  by  the  simplex 

method,  Thus  in  Problem  1  the  new  origin  that  was  first  obtained  gave  a 

feasible  solution  without  requiring  any  pivots  with  Gomory'e  algorithm.. 

Problem  1  is  interesting  on  two  additional  counts „  No  solution,  obtained  after 

the  first  one  was  able  to  improve  on  it.  Moreover*  the  algorithm  devoted 

330  pivots*  to  the  fourth  new  origin,,  and  obtained  nothing,  though  the 

difference  between  this  origin  and  the  previous  new  origin  was  simply  a  unit 

0 

reduction  in  the  value  of  w, 

X 

The  first  new  origin  or.  Problem  2  did  not  givo  a  feasible  solution,  and 
it  took  8  surplus  pivots  to  find  one-  The  second  origin  was  not  only  feasible, 
but  turned  out  to  be  the  minimum  solution,  though  this  was  not  verified  until 
the  answer  had  been  gotten  twice  more,,  45  pivots  later, 

Problem  3  demonstrates  two  more  of  the  eccentriei  ties  of  tho  NOT,,  Here 
the  point  of  interest  is  in  the  difference  between  the  results  of  the  two  solu¬ 
tion  trials..  The  best  answer  obtained  in  both  trials  was  the  same,  and  each 

0 

of  the  w . *  for  tills  solution  was  greater  than  or  equal  to  the  w.  of  the  new 

J.  1 

origin  which  produced  it...  The  first  solution  obtained  on  the  second  trial, 
ho v ever ,  was  better  than  the  corresponds ng  one  of  the  first  trial,,  though  both 
were  bused  on  the  same  origin.  The  superior  solution  was  obtained  in  fewer 
pivots  and  has  the  novel  property  that  one  of  the  variables  which  was  given 
a  nonzero  value  in  the  new  origin  was  zero  in  the  final  answer „ 

'  The  simplex  method  required  i  pivots  on  this  problem. 
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In  Problem  4  the  second  trial  agrees  -wi  th  the  first  on  three  of  the 
feasible  solutions,-  but  registers  one  additional  solution*  which  turns  out  to 
be  the  best  one  found.  This  sclution£,  like  the  first  one  obtained  in  the 
second  trial  of  Problem  3 »  was  based  on  a  new  origin  that  could  not  safely 
have  been  relied  upon  to  produce  it,  Nonetheless,  none  of  the  theoretically 
safe  origins  were  successful  in  producing  the  solution  on  either  trial,,  luch 
results  suggest  that  a  study  of  pivot  sequencing  for  the  MOT  might  prove 
more  fruitful  than  for  Gomory's  algorithm  alono. 

Finally,  a  word  about  the  NOT  applied  to  problems  of  a  larger  size,, 

.«e  have  received  five  problems  from  Ralph  Gomory ,  and  have  tested  the  NOT  and 
the  fandom  hide  on  four  of  them  in  the  same  way  as  the  rules  were  tested  on. 
the  eight-  variable  eight  inequality  problems,  (he  currently  do  not  have 
enough  computer  memory  space  to  handle  the  fifth  problem.,)  The  fandom  Hula 
was  unsuccessful  in  solving  any  of  the  four  problems  using  the  40G  pivot- 
cutoff  and  raking  four  solution  attempts  at  each  problem.  The  NOT  obtained 
feasible  solutions  to  three,  though  wo  cotV't  know  whether  these  solutions  are 


optimal 


The  results  of  the  NOT  on  these  problems  are  itemise 
-,'e  suggest,  however,  that  the  NOT'’ 3  performance  on  large  pi- 
may  be  somewhat  different  than  for  the  ,  roblams  used  here,, 
the  solutions  which  the  NOT  found  were  obtained  by  rounding 
the  simplex  tableaus  upward.  The  structure  of  the  problems 


d  in  Table  III., 
obleras  in  gensr 
The  reason  in 
the  var.i acres 
Picnics  ,i.t  appea 


al 


fn  »i; 


that  the  feasible  solutions  are  good,  but  for  an  adequate  test  of  the 


problems  with  optimal  solutions  substantial!;.’ 


removed  from  any  ob; ainud  by 


upward  rounding  should  be  tried , 
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TABLE  H- 


Problems  5  Hus  t  rating  Variations  "a  las  Behavior  of  the  NOT 
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APPUiDIX  A 


Tiw  A;  ‘  T-gteffev  >>  ■:  e&cr  3:rog--esr'...ig  Algorithm. 

v0(  a  of  the  Problem.  Minimize  wb  -t  >n  subject  to  wA  >  c;  w  >  0„  w  integer 
n  the  above  viorat’on  vf  and  !  are  row  vectors.,  b  end  •'•  are  column  vectors, 
b.-j  u:  •■»  .-  all:',  aiid  A  is  a  main'?.  al.\  of  which  are  entirely  integer,  and  of 
d;m  Vi.jJ oxt:3  su-h  : hat  the  pvob’len  4 a  w*13  -defined  • 

Inxltal  ‘abteau 


l.a,-  f  the  "d  ab.'cw:  3r>t"Uf''  fc  -med  by  annexing  the  column  vector 

li  o  the  lof„  of  A  ansi  I.  av  'n  ‘he  upper  portion  of  the  tableau  above., 

V-  tix.7  subBsqueir  t  >b,U;a.>  ?  yl-  continue  ho  dmote  the  matrix  .found  in  the 


say?  loc.it  ton  I  v  'V 

the  vector  corresponding  to  the  i 

th  row  of  ? 

y/  T.  <  T{  we  wilf  mean 

J*h3t  fi\ 

j, 

s  ’ e;c  c •‘graphically  less  than  T  •  . 

if 

G  ®vy'8  alg-er  -re 

fl-7J2  '.V.pCl 

Ha'.  ?;>  0  ( !f»x<  rographirally)  foe 

a U  l  Ilf 

they  a.-e  not.  a  ru; 

:  h'd 

exist- a  foe  mailing 

hem.  sc)- 

The  algorithm  Is  called 

;  !w  aJ  i  ntegB*‘  me 

thod 

be’au3t:  ail  coeff ' 

orient  o  in 

the  tableau  remain  integer 

du-:’  ng  the  entire 

‘  al  ■: 

val  ion  g‘<  non  chat 

4  he  entr5 

eo  In  the  initial  tableau 

w5--n  integers 

slup-  v  y  n  2-v.  r>b.  vg  So'-iory1  a  algorithm  in  the  diagram  which 
fol-owc;  let  the  «iui”r*x  ''nit  >.aVy  consisting  of  A  and  I  be  denoted  simply 
by  A  and  1*>.  the  vt  ..'.or  n  l  il’y  consisting  of  >•  and  0  be  denoted  by  c 
Again.  'n  si ib ^eqicn1:  tableaus.  A  and  c  will  denote  the  matrix  and  vector 
found  .‘r.  the  sam^.  .'c-cafions  as  ‘he  original  A  and  e 


DIAGRAM  FOR  COHORT'S  ALGORITHM 


If 


a.  lo r  all  i  (\r.e::.  C  <0),  the  ’.rob lea 

.tu'“  J 


v,-  •: 


**  The  objective  function  value  (negative!.1,' 
location  initially  occupied  by  and 

appears  in  the  partition  of  the  Lotto  '  v 


signed)  approve  in  the 
the  solution  vector  v.  -  T 

1  ; ■"  •„ ]  *>1  '..'T  ;  a  - 
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APPENDIX  B 


Theorem  L,  Let  Lw^a^  *  c  represent  the  constraint  chosen  for  pivot 
from  a  simplex  tableau  T  Lot  the  "prime"  superscript  ( ! )  denote  values 
pertaining  to  the  tableau  T-  derived  from  ?  by  the  pivot  operation?  for 
example,  Ew,  a  “  -  e3  refers  to  the  pivotal  constraint  from  T  as  it 
appears  in  Ts,  Finally,  let  w®  end  \P,  denote  the  components  of  w  derived 
from  the  pivotal  constraint  in  T,  and  .let  (v/V .)'  and  (w^,)f  denote  the 
components  of  w°  obtained  from  the  30me  constraint  as  it  appears  in  T  „ 
Then  i  -  j  ~  i5 ;  and  w?  ~  (wp%  -  fwj,)'. 

Proof?  To  show  this  it  is  necessary  first  to  show  that  if  a  /b  <a  /b 
-  is  isr  rv  n 

for  the  pivotal  constraint,  then  --a  ,/b  <-a  ,/b  ,  after  the  pivot., 

ur  m  "  ti"  n1 

This  implies  in  particular  that  j'1  *  i„  The  simplex  algorithm  defines 
"  %/\  *  \  tyyV’  a./bi  «•  Edi^a^)  far  afe<0, 

The  subscript  i.  it  should  be  noted,  is  defined  the  same  for  the  pivot 
element  a.  and  the  new  origin  value  w®  of  Theorem  j  for  any  constraint 
which  is  eligible  for  pi  vet  ring ,  he  then  may  write 

(')  -*v/ckr  l  ajc.,aj_)/  ^  ”■  (aiAi  '/( (V13},)'0!  ^ 

Inspection  of  this  Latter  form  shows  the  assertion  of  order  preservation 
to  be  valid.  Thus  j-  *  i , 
he  row  observe  that 


■a  /b  where  a  .  /*b  .  »  min(-a,  ,,/b.  k  4  i, 
v  r1  r  '  r‘  V'  ic  ' 


Rearranging  (7)  er.ee  again,  £p  may  be  written  as 

P  (a  /b  i/((  \  J'c  )'o.  ■  n  )  -  ?/iHh.  •  a. ) 
v  r  •  '  i  .r  i  i  ■  •  1  x 


